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1. ABSTRACT 

TMe-t^-dMeiOb.. .the short- and long-term autonomous robot control 
activities in the Robotics and Teleoperators Research Group at the Jet 
Propulsion Laboratory (JPL).v. This group is one of several lnvol j;* d i, l r0bQt ^! 
which is an integral part of\a new NASA robotics Initiative called Tele obot 

program. Thi3„J»P®r- -provide s v t ;^ description of the architecture, hardware and. , 

software, andthe research dlretf^lon in manipulator controls— } I / / 

'' f\ [U. dtss/ficej » 

2. INTRODUCTION / 

The TeleroJ program is a new project initiated in 1 i^aVd 

technology base/ln the areas of teleoperators, ro o to^avaloo and integrate the technologies to be used in 
other sensors, /and manipulators. The objective i» to velop ^ oration. To realize the 
future NASA endeavors, particularly for on-or ** 3 hatf _ he« n funded to develop core technologies with broad 
goals of the drogram, JPL and ^out . ^ of the developed 

applications an automation and robotics and _, afmad fop iqra 1990, 1993, and beyond. Each successive 

Tu ^ U. .... o„ 

taslT The fLong- term goals of the group's activities will also be described. 


3. TH.ER0B0T ARCHITECTURE 

I . 1 1 1 anc i validate theoretical developments at JPL and other 

A testjbed is required as a Eane^ [aciUty to t«t Jjd for the Telerobot Testbed 
NASA centers. JPL has developed a flexible and hierarch! y It t3 recognized that in the 

facility, figure 3-1 taste 'execution. ft. architecture is 

foreseeable! future human intelligence w *V ... , he aut0 nomou3 taste execution at any time. Certain 

designed sol that the °^ rat ° r< ^ ”£, U " the risk ^f damaging the workpieces or the manipulators by prohibiting 
provisions w.ere necessary to eliminate 8 instances. For example, stopping the 

the operator from hal ting the CO uld possibly damage either the arms or the satellite or 

autonomous activity during a satellite capturing task coul po ^knowledge the operator's desire to stop the 

.i^tS-is'srsrt ^ — - - * 

complete stop. An overview of this architecture is documented in reference CD- 

On the autonomous side, the AIP (Artificial Intelligence Planner) will develop task scripts from requests 
made by the operator and will specif certain regions of space in which the arms oust be moved based on global 
spatial planning. In the near-term, most of the AIP activities will be off-line. It is envisioned that the AIP 
will have on-line task planning and error recovery in the future. 

Run Time Control (RTC) is the second subsystem in the hierarchy. This subsystem serves several important 

Sensing and Perception is a subsystem which will provide acquisition and tracking capability for the 
tracking of known but unlabelled moving objects and position verification for fixtures on workplecas (e.g. 
bolts, handles, etc.). The vision system currently under development includes custom-designed image-processing 
hardware, and acquisition and tracking software running on a general purpose computer. More detailed 
information on this subsystem and its retivities are documented in references [«] and [5J. 
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TESTBED TASK CONTROL HIERARCHY 



Figure 3.1 Testbed Teak Control Hierarchy 

Manipulator control and Mechanization (MCM) la the aubsyatea that la responsible for trajectory generation 
and low-level control of the manipulators In the autonomous mode of operation. Sections k and 5 will provide a 
detailed description of this subsystem and current research activities. 

The teleaperator subsystem forms a parallel link to the autonomous hierarchy so that the operator can 
control the manipulators directly. The control is based on the operator generating commands by physically 
moving two six degree- of- freedom (DOF) force reflecting hand controllers with the remote site manipulators 
responding to tnese commands. The hand controllers themselves are six DOF manipulators with DC motors to 
realize force reflection, and use a distributed microprocessor computing architecture. References (73 through 
J provide a more detailed description of this subsystem. 


U. MANIPULATOR CONTROL AND MECHANIZATION SUBSYSTEM 

The goal of this subsystem is two-fold. It is designed to 1) provide low-level robot control for the 
Telerobot testbed facility and 2 ) furnish a research facility for testing robot control algorithms. The 
selection and design of the software and hardware for this subsystem were based on several factors, among which 
portability and extendlblllty wers critical. Although when viewed from the Telerobot system level, MCM can be 
considered to be a low-level system, MCM itself has several levels of hierarchy. The software is based on a 
robot language, RCCL (Robot Control "C" Library), developed at Purdue University by Professors Richard Paul and 
Vincent Hayward [10j-[12], A brief description of the software architecture Is given later in this section 

The manipulator hardware at the present time consists of three PUMA 560 robots. One of the arms will serve 
as a platform for positioning and orienting a pair of stereo cameras for the Sensing and Perception subsystem. 
The other two arms, which will be used for single and dual arm manipulations, are mounted on lathe beds so their 
relative distance can be modified to accommodated various task requirements. In the future this system will be 
mechanized to provide servo controlled simultaneous relative positioning of the manipulators* single and dual 
arm operations. This will Increase the work volume of the manipulators and will bring about challenging 
theoretical problems both in task planning and cooperating arm control. The manipulation arms are equipped with 
commercial (LORD Corporation) force-torque sensors with associated microprocessors. These arms are also 
currently equipped with simple or.-off pneumatic grippers. 
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The testbed Includes a 350 pound satellite aockup which own spin and nutate freely on a gimbal for up to 
several minutes, closely simulating the dynamics of a real satellite. The satellite mockup Js fitted with a 
panel which is affixed to one of its sides by means of four screws. The removal of the panel can best be 
accomplished by two cooperating arms after the screws are removed. The task complexity can be Increased by 
mounting various elements under this panel, such as PC boards and electrical connectors with cables attached. 
The satellite aockup is also fitted with an (EVA) fluid connector, which Is a coupling device designed for 
transferring fluids and low pressure gases. The assembly anu removal of this coupler also introduces single and 
dual arm rorce/positlon control problems that must be dealt with. The setup presents many realistic and complex 
problems for robot task planning and control. One challenging task la to track the position/orientation of the 
slowly spinning satellite by the Sensing and Perception subsystem, grapple with the satellite and bring it to a 
rest position without exerting excessive forces/torques on the arms. This task requires cooperative arm control 
as soon as the arms come in contact with the satellite. Figure 4.1 shows the MCH testbed facility. 



Figure 4.1 ?e 3 t bed Facility at. the Robotics ir.d Tel coper ator3 Research Group 


The computing facliities at the present time are a MicroVax II, 
a icroproces 30 r s of tne force torque censors. Figure 4.2 illustrates the 
and its interface with RTC and Tensing and Perception. Tin. e RJTL plays a 
.brief description of the language and its capabilities and limitations 
detailed information see references [13] and ,14;. 


inroe (Inmate controllers and the 
detailed hardware schematics of MCM 
central role in the MTV subsystem, a 
will he discussed solcw. For more 


The system software consists of a series of progr.una 
4.3 shows a bloc* diagram of the RCTL architecture. The co 
servo .control uni ts. The l.T.i 11, "’3 microprocessor m the 
1 in* the MicrcVax 11 to '.he 6503 joint microprocessors, 
program it a preselected sampie rate. At every mterrup 
information about the state of tne robot arm, includln 
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runnlrg si mui tar.ecuniy -on various 
^figuration uses the 'Jr.lmate -ontro 
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Interrupts tbs oontrol level on ths MicroVax II, transaita this dsts, wslts for ths control levsl to return s 
s«t of Joint ooaaands, and than dispatches these coaaands to the required Joints. The ssaple rate can be 
abashed froa its noraal setting of 28 asec to 56, It and 7 a sec. 

The MlaroVax II oon tains the planning and control prograaa, which run concurrently with each other. The 
planning level, which interacts with the user, operates in ths noraal tlae-sharing context and has access to all 
standard resources, such as files, devices, and systea calls. The user, utilizing the library functions, 
specifies by a Cartesian fraae the goal position snd via points that the end-effector aust pass through The 
planning level foras a notion queue based on the sequence in which the user has specified the notions. High- 
level functions are available to change the ssaple rate and aodlfy the planned path in real-tlae based on either 
an laterally generated path nodifier or by use of external sensors. 

The oontrol level runs in the foreground and exscutos a nuaber of procedures at the saaple rste of the 
systea. (then it is Interrupted by the LSI 11/73 it first checks the received lnforaatlon for data integrity and 
the noraal status of the eras' joint servos. The data consists of Joint angle readings, aotor currents, and 
the robot's status. In the JPL lapleaantatlon, the data also includes the force/torque readings received by the 
LSI 11/73 once every saaple tlae. The prograa then transaits the new set points that this level has ooaputed in 
the last saaple interval through the LSI 11/73 to tie Joint alcroprocessors. It then executes a control 
function (see Fig. 4. 4) to calculate a new set of Joint servo settings. This control function is noraally a 
trajectory generator but, as was aentioned earlier, it can also include a user function for real-tlae 
aodlficatlon of the trajectory which the user has defined at the user level. To aeet the constraints laposed by 
the saaple rate, the oontrol level executes in the highest priority node. The set points noraally are new Joint 
positions but can also represent aotor currents for force servolng. 



Figure 4.4 Control Level Software Block Dlagraa 
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— T «ierobot eu beret earn will be oonmcted to for* a network with an Etharnat cable. Tha subsystems will 
coaaunloate with each other wains tha 10 .agablt Etharnat -physical link-. ****"•}* 

5 'KlT? running 

SS.r tt. m ni “«l« ^t.. i. »tUl».n " . link hot.’.’.. «h. 0.1. Ulorot., II .„d tb. otho, outoyoto... 
These two aloroVax ll*a are connected to each other via a shared aesory card. 

Although tha currant setup provides a flexible and portable programing enviromiant, there are 
. . . «h<wtoo«inaa that aust ha addressed. The current RCCL iapleaenUtion at JPL is viewed as a abort- 

probleas "f j*£*^*^ M , b t „ Oo# ppoblea with the current setup is that aost sophisticated robot 

syzzsss* jbttj: sas 

ol .„ for and control two or aore aras siaultaneously. A third problea lies with the uniaaie 
oontrollor Although it 1* pooolhlo to uao thl. oontrollor to run »rno oth.r than Unlnatlon a, on. ia llultod 
£"‘"“£.0 “d ^SloJlir Control ..thod u-d in th. o.rvo oontroll.r,. In th. folloulng tha u. o.aorlba our 
plana fop addressing these liaitatlona. 

Currently JPL is in the process of designing a low-level robot controller based on distributed 
this Mntpoller w ill have tha capability of controlling eight Joint aotors[15]. This 

£ln. do.UoMO toT.7l.““». Hiorovax II oo. put. r a. th. MCM cohputor. It th. pr.Mnt tin. only, 
^illnln.ry doolgn to .otaMl.h.o for thlo hor0u.ro. Hguro «.5 shouo « prolloln.ry block Ji**?" °f * if 
^rrt. pVr,, rLn ltv *nd its lntearatlon with tha Joint controller systea. To summarize, for 1988-1989 JPL will 
have u>r» main elements for advanced manipulator control. These are 1) progreaaahle Joint °° nt [ oll £ s 
nave uu-ee ' ■ various robots 2) an open architactura distributed microprocessor computing facility for 

trajectory pl^ngTndTon" ol of cooper. ting -anlpulstors. and 3) seven D0P modular space-like 

manipulators. 


Vision 
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Figure 4.5 Preliminary Architecture for MCM Distributed Microprocessor Computing Facility 
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5. RESEARCH IN MANIPULATOR KINEMATICS, DYNAMICS AND CONTROL 

Our research activity la in aupport of both near- and long-tar* goala aatabllahed by tha tba Talarobot 
program. In tha following we will daaoriba tha sain raaaaroh aotlvitiaa purauad by tha group in manipulator 
control and mechanization. 


5.1 Manipulator Geometry Modelling 

Ona of tha moat important functions of autonomous robots is movement of their and-effectora to various 
location* in the work space. Tasks performed by these robots require a certain positioning accuracy. 
Experience with industrial robots has shown that although tha relative positioning accuraoy (or repeatability) 
la satisfactory, the absolute positioning accuracy is not acceptable. This inaccuracy la largely due to 
uncertainty in the manipulator's geometric parameters. Our research has resulted in a parameter identification 
technique to update the geometric errors of the manipulators. Both simulation and actual laboratory experiments 
have shown tho validity of the technique. 


An associated problem with the geometry calibration is the inverse kinematics problem of so called near- 
simple manipulators. To utilize the results obtained from the above geometric calibration one must incorporate 
the improved knowledge of tho link parameter errors in the forward and Inverse kinematioa equations of the 
calibrated robot. Modification of the forward kinematic equations la very simple. Modification of the inverse 
kinematics, unfortunately, is not so easy. It is well known [17] that for a large class of robots the inverse 
kinematic solution can be obtained in a dosed form. The condition for the existence of an analytic solution is 
that at least three consecutive joint axes must Intersect at on* point (a "simple" arm). The post-calibrated 
model of the robot, which more accurately represents the physical system, is that of a non-slmpl* one. The 
inverse kinematic equations are solved by first finding the dosed form solution for the ideal model and * then 
computing small variations to be added to the joint angles by utilizing the Jacobian of the post-calibrated 
model. For more detail see references [l8]-(20]. 


5.2 Ms del- based Dual Arm Control 

The topic of mdtiple robot control is relatively new in robotics research. The extension of robot control 
techniques to the case of mdtiple manipulators is necessitated by realities encountered both for manipulating 
small objects and for handling large workpieces. The manipdatlon of objects normally requires at least two 
hands to simultaneously position and reorient the object so that either on* or both hands can perform their 
respective tasks. 


Our research in this area has been based on the derivation of the equations of notion in the so-called 
Operational Space (or Cartesian state space). He assume a general case of n cooperating robots which are holding 
an object rigidly. This object may dso be constrained fro* motion in one or more dimensions by an external 
environment. Equations of motion are derived using the Lagrange mdtiplier technique. It is assumed that each 
manipdator is equipped with a force/torque sensor capable of measuring three orthogonal forces and torques In a 
Riven coordinate frame. The aim is to control the position of the object and its interaction forces with the 
environment in the sense of hybrid control of Halbert and Craig [21]. Utilizing these dynamics equations a 
decoupling controller in configuration space is designed to control both the position and the interaction forces 
of the object with the environment. Preliminary simulation studies on a simple system which consists of a pair 
of two-link manipulators holding a load which interacts with an environment have shown that the control 
technique yields excellent results. For more details please refer to references [22] and [23]. 


5.3 Adaptive Control of Manipulators 

Adaptive control offers an appealing solution to the control problem. In adaptive robot control methods, 
neither the complex mathematical model of the robot dynamics nor any knowledge of the robot parameters or the 
payload are required to generate the control action. Adaptive control methods fall into two distinct 
categories, indirect and direct. In direct adaptive control methods the control action is generated directly, 
without prior parameter estimation. Research in this area was started by the application of adaptive control 
techniques to control the manipulator in Joint space. Research was then extended to the control of manipulators 
in Cartesian space. Further research resulted in an adaptive control technique for simultaneous position and 
force control of manipulators. Most recently, an adaptive controller was formulated for the control of multiple 
cooperating robots. Simulation studies on two link manipulators have shown excellent results for all of the 
above adaptive controllers. Additional detail is contained in references [2R]-[27]. 


6. CONCLUSIONS AND FUTURE RESEARCH DIRECTION 

0 

Most of the Robotics and Teleoperators Research Group's research activity in the manipulator control area 
is of a theoretical nature. Much effort and further research will be required to implement the proposed control 
algorithms. Several important realistic problems such as arm friction and backlash. Joint flexibility, 
computational complexity resulting in low sampling rates, finite measurement resolution and measurement noise 
will have to be considered before a robust controller can be realized. Further theoretical work in multiple 
cooperative arm control and redundant an» control is currently being .carried out. 
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